Systems and methods for matching, naming, and displaying medical images

ABSTRACT

A method of matching medical images according to user-defined matches rules. In one embodiment, the matched medical images are displayed according user-defined display rules such that the matched medical images may be visually compared in manner that is suitable to the viewer&#39;s viewing preferences.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.14/244,431, filed Apr. 3, 2014, entitled “SYSTEMS AND METHODS FORMATCHING, NAMING, AND DISPLAYING MEDICAL IMAGES,” which is acontinuation of U.S. application Ser. No. 13/345,606, filed Jan. 6,2012, entitled “SYSTEMS AND METHODS FOR MATCHING, NAMING, AND DISPLAYINGMEDICAL IMAGES,” now U.S. Pat. No. 8,731,259, which is a continuation ofU.S. application Ser. No. 12/870,645, filed Aug. 27, 2010, entitled“SYSTEMS AND METHODS FOR MATCHING, NAMING, AND DISPLAYING MEDICALIMAGES,” now U.S. Pat. No. 8,094,901, which is a continuation of U.S.application Ser. No. 11/265,978, filed Nov. 3, 2005, entitled “SYSTEMSAND METHODS FOR MATCHING, NAMING, AND DISPLAYING MEDICAL IMAGES,” nowU.S. Pat. No. 7,787,672, which claims priority under 35 U.S.C. § 119(e)to U.S. Provisional Application Ser. No. 60/625,690, filed on Nov. 4,2004, each of which are hereby expressly incorporated by reference intheir entireties and for all purposes.

BACKGROUND OF THE INVENTION Field of the Invention

This invention relates to matching, naming, and displaying medicalimages based upon user-defined rules.

Description of the Related Art

Medical imaging is increasingly moving into the digital realm. Thisincludes imaging techniques that were traditionally analog, such asmammography, x-ray imaging, angiography, endoscopy, and pathology, whereinformation can now be acquired directly using digital sensors, or bydigitizing information that was acquired in analog form. In addition,many imaging modalities are inherently digital, such as MRI, CT, nuclearmedicine, and ultrasound. Increasingly these digital images are viewed,manipulated, and interpreted using computers and related computerequipment. When medical images are created, they are typically providedan identifier, label, or name. This name can be either automaticallygenerated or provided by a technician. One problem with organizingmedical images from different sources is that these identifiers do notnecessarily provide a good description that is understandable to asubsequent viewer of the image. Furthermore, as the number of imagesincrease, there is a need for improved methods of matching relatedmedical images together for subsequent viewing and analysis.

SUMMARY OF THE INVENTION

One embodiment comprises a method of displaying medical data. The methodcomprises receiving a plurality of medical images of a first medicalexamination and receiving at least one user-defined matching rules, atleast one of user-defined matching rules identifying selection criteriafor the medical images. The method also comprises selecting medicalimages that satisfy the selection criteria of the user-defined rules,thereby matching medical images according to user-specific rules andreceiving at least one user-defined display rule, at least one ofuser-defined display rules identifying a display preference with respectto selected medical images. The method also comprises displaying theselected medical images according to the identified display preferences,thereby allowing matched medical images to be visually compared anddisplayed in a manner that is suitable to the user's preferences.

Another embodiment comprises a method displaying medical data. Themethod comprises receiving a plurality of medical images of a firstmedical examination and receiving a plurality of medical images of asecond medical examination. The method also comprises receiving at leastone user-defined matching rule, at least one of user-defined matchingrules identifying selection criteria for matching the medical images ofthe first and second medical examinations. The method also comprisesselecting medical images that satisfy the selection criteria of theuser-defined rules, thereby matching medical images of the first medicalexamination with medical images of the second examination according touser-specific rules. The method also comprises receiving a plurality ofuser-defined display rules, at least one of user-defined display rulesidentifying a display preference with respect to selected medicalimages. The method also comprises displaying the selected medical imagesaccording to the identified display preferences, thereby allowingmatched medical images to be visually compared and displayed in a mannerthat is suitable to the user's preferences.

Another embodiment comprises a system for displaying medical data. Thesystem comprises an electronic device being configured to receive aplurality of medical images of a first medical examination. Theelectronic device is configured to receive a plurality of user-definedmatching rules. At least one of user-defined matching rules identifyselection criteria for the medical images. The electronic device isfurther configured to select medical images that satisfy the selectioncriteria of the user-defined rules, thereby matching medical imagesaccording to user-specific rules. The electronic device is furtherconfigured to receive at least one user-defined display rules. At leastone of user-defined display rules identify a display preference withrespect to selected medical images. The electronic device is furtherbeing configured to display the selected medical images according to theidentified display preferences, thereby allowing matched medical imagesto be visually compared and displayed in a manner that is suitable tothe user's preferences.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an exemplary computing system incommunication with a network and various networked devices.

FIG. 2 is a flowchart illustrating an exemplary process of matching anddisplaying medical images.

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION

Embodiments of the invention will now be described with reference to theaccompanying figures, wherein like numerals refer to like elementsthroughout. The terminology used in the description presented herein isnot intended to be interpreted in any limited or restrictive manner,simply because it is being utilized in conjunction with a detaileddescription of certain specific embodiments of the invention.Furthermore, embodiments of the invention may include several novelfeatures, no single one of which is solely responsible for its desirableattributes or which is essential to practicing the inventions hereindescribed.

FIG. 1 is a block diagram of an exemplary computing system 100 incommunication with a network 160 and various network devices. Thecomputing system 100 may be used to implement certain systems andmethods described herein. The functionality provided for in thecomponents and modules of computing system 100 may be combined intofewer components and modules or further separated into additionalcomponents and modules.

The computing system 100 includes, for example, a personal computer thatis IBM, Macintosh, or Linux/Unix compatible. In one embodiment, theexemplary computing system 100 includes a central processing unit(“CPU”) 105, which may include a conventional microprocessor, anapplication module 145 that comprises one or more various applicationsthat may be executed by the CPU 105. The application module 145 mayinclude, by way of example, components, such as software components,object-oriented software components, class components and taskcomponents, processes, functions, attributes, procedures, subroutines,segments of program code, drivers, firmware, microcode, circuitry, data,databases, data structures, tables, arrays, and variables.

The computing system 100 further includes a memory 130, such as randomaccess memory (“RAM”) for temporary storage of information and a readonly memory (“ROM”) for permanent storage of information, and a massstorage device 120, such as a hard drive, diskette, or optical mediastorage device. Typically, the modules of the computing system 100 areconnected to the computer using a standards-based bus system. Indifferent embodiments of the present invention, the standards based bussystem could be Peripheral Component Interconnect (PCI), Microchannel,SCSI, Industrial Standard Architecture (ISA) and Extended ISA (EISA)architectures, for example.

The computing system 100 is generally controlled and coordinated byoperating system software, such as the Windows 95, 98, NT, 2000, XP orother compatible operating systems. In Macintosh systems, the operatingsystem may be any available operating system, such as MAC OS X. In otherembodiments, the computing system 100 may be controlled by a proprietaryoperating system. Conventional operating systems control and schedulecomputer processes for execution, perform memory management, providefile system, networking, and I/O services, and provide a user interface,such as a graphical user interface (“GUI”), among other things.

The exemplary computing system 100 includes one or more of commonlyavailable input/output (I/O) devices and interfaces 110, such as akeyboard, mouse, touchpad, and printer. In one embodiment, the I/Odevices and interfaces 110 include one or more display devices, such asa monitor, that allows the visual presentation of data to a user. Moreparticularly, display devices provide for the presentation of GUIs,application software data, and multimedia presentations, for example. Inone embodiment, a GUI includes one or more display panes in whichmedical images may be displayed. According to the systems and methodsdescribed below, medical images may be stored on the computing system100 or another device that is local or remote, displayed on a displaydevice, and manipulated by the application module 145. The computingsystem 100 may also include one or more multimedia devices 140, such asspeakers, video cards, graphics accelerators, and microphones, forexample.

In the embodiment of FIG. 1, the I/O devices and interfaces 110 providea communication interface to various external devices. In the embodimentof FIG. 1, the computing system 100 is coupled to a network 160, such asa LAN, WAN, or the Internet, for example, via a communication link 115.The network 160 may be coupled to various computing devices and/or otherelectronic devices. In the exemplary embodiment of FIG. 1, the network160 is coupled to imaging devices 170, an image server 180, and amedical facility 190. In addition to the devices that are illustrated inFIG. 1, the network 160 may communicate with other computing, imaging,and storage devices.

The imaging devices 170 may be any type of device that is capable ofacquiring medical images, such as an MRI, x-ray, mammography, or CT scansystems. The image server 180 includes a data store 182 that isconfigured to store images and data associated with images. In oneembodiment, the imaging devices 170 communicate with the image server180 via the network 160 and image information is transmitted to theimage server 180 and stored in the data store 182. In one embodiment,the image data is stored in Digital Imaging and Communications inMedicine (“DICOM” format. The complete DICOM specifications may be foundon the National Electrical Manufactures Association Website at<medical.nema.org>. Also, NEMA PS 3—Digital Imaging and Communicationsin Medicine, 2004 ed., Global Engineering Documents, Englewood Colo.,2004, provides an overview of the DICOM standard. Each of theabove-cited references is hereby incorporated by reference in theirentireties. In one embodiment, the data store 182 also stores theuser-defined display rules associated with one or more of the imagesstored on the data store 182. As discussed in further detail below, theuser-defined display rules may vary depending of the type of image, areaimaged, clinical indication, source of image, display device, user, orother factors. Accordingly, any type of user-defined display rule isexpressly contemplated for use in conjunction with the systems andmethods described herein.

The exemplary image server 160 is configured to store images frommultiple sources and in multiple formats. For example, the image server160 may be configured to receive medical images in the DICOM format frommultiple sources, store these images in the data store 182, andselectively transmit medical images to requesting computing devices.

The medical facility 190 may be a hospital, clinic, doctor's office, orany other medical facility. The medical facility 190 may include one ormore imaging devices and may share medical images with the image server180 or other authorized computing devices. In one embodiment, multiplecomputing systems, such as the computing system 100 may be housed at amedical facility, such as medical facility 190.

Definition of Terms

Below is a definition of certain terms used herein.

“Modality” is defined as a medical imaging device (a patient whoundergoes an MRI is said to have been examined or scanned with the MRImodality).

“Medical image” is defined to include an image of an organism. It mayinclude but is not limited to a radiograph, computed tomography (CT),magnetic resonance imaging (MRI), Ultrasound (US), mammogram, positronemission tomography scan (PET), nuclear scan (NM), pathology, endoscopy,ophthalmology, or many other types of medical images. While thisdescription is directed to viewing and tracking of medical images, themethods and systems described herein may also be used in conjunctionwith non-medical images, such as, images of circuit boards, airplanewings, and satellite images, for example.

“Patient” refers to an individual who undergoes a medical imagingexamination.

“Viewing” is defined to include the process of visually observing one ormore medical images associated with exams.

“Viewer” is defined as any person who views a medical image.

“Reading” is defined to include the process of visually observing one ormore medical images for the purpose of creating a professional medicalreport, also called an interpretation. When reading is complete, an exammay be labeled “read,” indicating that the medical professional hascompleted observation of the one or more medical images for purposes ofcreating a medical report.

“Reader” is defined to include one who is authorized to perform thereading process.

“User” is defined to include any person that is a viewer and/or areader.

“Display rules” are defined to include methods of display of an image orexam. For example, an image or exam may be displayed with a certainpixel window level or width (similar to brightness and contrast), incolor, based on a certain color map, opacity map, or other displayparameters.

“User-defined display rules” refers to rules that a user can establishand store in a database that establish criteria for image display thatis considered adequate. For example, a user-defined display rule mightstore a rule that triggers certain warnings or displays if all pixels ina medical image have not been displayed or, alternatively, if at least apredetermined portion of the pixels have not been displayed with acertain display method (such as image window, level, brightness,contrast, opacity, color look-up table, or other parameters).User-defined display rules may also refer to other image processingfunctions, such as edge enhancement and automated image analysisfunctions, e.g., computer-aided detection (CAD) techniques.

FIG. 2 is a high-level flowchart describing an exemplary method that maybe performed by the computing system 100 (FIG. 1). Depending on theembodiment, additional steps may be added, others removed, and theordering of the steps rearranged.

Starting at step 200, matching rules are provided with respect tomedical images that are accessible by the computer system 100. Themedical can be accessible via the imaging server 180, be local to thecomputing system 100, or elsewhere accessible via the network 160. Thematching rules establish criteria for matching related medical images.In one embodiment, the matching rules are defined for a particularindividual or machine. In another embodiment, the matching rules aredefined for a group or class of individuals. The rules may be providedby the users themselves and/or by a system administrator. Theauto-matching rules may be established to select medical data based uponany of the following non-limiting criteria: modality (MRI, CT, X-rayetc); exam type (left knee X-ray, CT Chest, MRI Brain etc); archivestatus (has the exam been archived, archived and restored, not yetarchived); assigned physician (has the exam been assigned to aparticular physician for interpretation); exam age (how long ago was theexam done); patient age; and any item in a DICOM header file, such asorientation, contrast use, thickness of slices, field of view, MRItissue contrast weighting, and other items. With regard to somecriteria, such as MRI tissue contrast weighting, the rules may analyzethe MRI pulse sequence and the imaging parameters in order to determinethe tissue contrast weighting and subcategorize images into weightingcategories or weighting names.

The matching rules can be used to match medical images in the sameand/or different medical series. For example, assume the medical imagesrelate to three series of 6 x-rays. The matching rules can beestablished such that like views amongst each of the different seriesare grouped together for subsequent viewing. The matching rules bedefined using simple or complex search expressions such “AND” or “OR.”Complex filter criteria may be stored on the image server 180 and thenused by local devices that access these records via the web.

Next, at a step 204, display rules are provided with respect to themedical images. In one embodiment, the display rules may be user-definedallowing the user to determine the timing, positioning, and size ofdisplayed matched images. For example, a user can define that matchedmedical images are all displayed concurrently on a display. Also, forexample, a user can define that the most recent of the matched medicalimages are displayed on the left hand portion of the display and theother matched medical images are displayed in sequence on the right handside of the display, the sequence advancing in response to userprompting. In one embodiment, the display rules include directives(timing, positioning, and size). As an example, directives can includethe following for identifying location information: TOP_DISPLAY,BOTTOM_DISPLAY, RIGHT_DISPLAY, LEFT_DISPLAY, CENTER_DISPLAY.Furthermore, if the number of matched medical images is variable, thedisplay rules can include instructions for identifying selected medicalimages based upon further rules, such as using the matching criterialisted above. In addition, the display rules may or may not define howmany images or image series are displayed per monitor, a display grid(2×3, 5×4, etc.), or whether like images are displayed neighboring eachother side by side horizontally or vertically. Furthermore, the displayrules may also specify how different matched medical images fromdifferent series may be “interleaved” together for successive display.Using the computing system 100, a user may also manually interleavematched medical images, e.g., order the matched medical images forprogressive display of each of the matched sets. The computing system100 may also provide an interface to re-order images or image series tofacilitate the matching display, and may even reorient images (flip,rotate) in order to best match the display. Using the display rules, theuser can provide display rules such that related medical images arereadily comparable.

In one embodiment, display rules may be set to display pre and postcontrast axial T1 weighted images from a brain MRI from the same exam inadjacent panes on a monitor. Display rules may also be set to displayaxial T2 weighted MRI images from a prior spine MRI adjacent to axial T2weighted images from the current exam. Display rules may also be set todisplay a PA projection from a chest radiograph from a prior examadjacent to the same projection from the current exam.

Continuing to a step 206, naming rules are provided. The naming rulesdescribe how the medical images can be provided a new “name”, label, oridentifying description. In one embodiment, the naming rules are definedfor a particular individual or machine. In another embodiment, thematching rules are defined for a group or class of individuals. Therules may be provided by the users themselves and/or by a systemadministrator. The naming rules can define sets of naming rules fordifferent exam types or other classifications. The naming rules can alsobe defined to perform naming before or after the matching step 216. Inone embodiment, the naming rules define how information in a headerfile, e.g., DICOM file, that is associated with the medical image isdescribed. The naming rules can define that the new name of the medicalimage is defined using meta or other data that is associated with themedical images. It is noted that the new name of the medical image neednot be stored with the image but such information can be stored by anydevice connected to the network.

Continuing to a step 208, in one embodiment, the medical images arereceived by the computing system 100. It is noted that in oneembodiment, the medical images need not be stored locally by thecomputer system 100 but are merely made accessible to it via thenetwork. Continuing to a step 212, the computing system 100 mayoptionally name the received medical images based upon the receiveduser-specific naming rules. In one embodiment, the new “names” of themedical images may be used by the computing system 100 to facilitatematching (step 216) of related medical images. In one embodiment, thenaming rules define how information in a header file, e.g., a DICOMfile, is described. The naming rules can define that the “new” name ofthe medical image is defined using meta or other data that is associatedwith the medical image. For example, the naming rules can define thatthe new “name” of the medical image is based upon the name of patient,the exam type, and the date of the medical image. Also for example, thenaming rules can define categorization tables that define a particularname when certain conditions are met. The particular name can bepredefined and/or based upon meta or other data that is associated withthe medical images.

Proceeding to a step 216, the computing system 100 matches medicalimages in the same or related series together as discussed above (step200). The matched images may be collectively or individually provided anew name per the naming rules provided in step 206. Continuing to a step220, the matched medical images are displayed. It is noted that thedisplay rules may define user display preferences that are specific forparticular types of medical images, e.g., the imaging modality, the bodypart, whether there is one exam, two, or more medical images beingdisplayed. The display rules may be defined per individual user, site,or system. In one embodiment, the user can store the display rules in adatabase. In one embodiment, one set of display rules can apply to onemodality and another set of display rules can apply to another modality.In addition, the display rules may include specific triggers or warningsthat occur if the user-defined display rules are not satisfied.

The foregoing description details certain embodiments of the invention.It will be appreciated, however, that no matter how detailed theforegoing appears in text, the invention can be practiced in many ways.As is also stated above, it should be noted that the use of particularterminology when describing certain features or aspects of the inventionshould not be taken to imply that the terminology is being re-definedherein to be restricted to including any specific characteristics of thefeatures or aspects of the invention with which that terminology isassociated. The scope of the invention should therefore be construed inaccordance with the appended claims and any equivalents thereof.

1. (canceled)
 2. A computing system comprising: one or more hardwarecomputer processes; one or more software modules configured forexecution by the one or more computer processors to cause the computingsystem to: receive a first imaging series including images of a firstmodality from a first imaging center; receive a second imaging seriesincluding images of the first modality from a second imaging center;receive at least one user-defined naming rule for images of the firstmodality based on DICOM attributes of each of the images of the firstmodality; and replace existing names of respective images of the firstand second imaging series, or append to existing names of the images ofthe first and second image series, with updated names according to theat least one user-defined naming rule, wherein the updated names arebased on one or more DICOM attributes of respective images.
 3. Thecomputing system of claim 2, wherein the one or more software modulesare further configured for execution by the one or more computerprocessors to cause the computing system to find matching related imagesusing the updated names.
 4. The computing system of claim 3, wherein theone or more software modules are configured to find the matching relatedimages using the updated names via one or more matching rules.
 5. Thecomputing system of claim 4, wherein the one or more matching rules aredefined for at least one selected from a group consisting of aparticular user, a particular machine, or a group or class of users. 6.The computing system of claim 4, wherein the one or more matching rulesfind the matching related images by matching images based on at leastone selected from a group consisting of modality, exam type, archivestatus, assigned physician, exam age, patient page, and an item in aDICOM header file.
 7. The computing system of claim 6, wherein the itemin the DICOM header file includes at least one selected from a groupconsisting of orientation, contrast use, thickness of slices, field ofview, and tissue contrast weighting.
 8. The computing system of claim 7,wherein the one or more software modules are configured for execution bythe one or more computer processors to cause the computing system toanalyze a pulse sequence and at least one imaging parameter of an imageto determine the tissue contrast weighting and subcategorize the imageinto weighting categories or weighting names.
 9. The computing system ofclaim 4, wherein the one or more matching rules match images in the sameor different medical series.
 10. The computing system of claim 4,wherein the one or more matching rules match images such that like viewsamongst each of a plurality of different series are grouped together forsubsequent viewing.
 11. The computing system of claim 4, wherein the oneor more matching rules are defined using one or more search expressions.12. The computing system of claim 4, wherein the one or more softwaremodules are further configured for execution by the one or more computerprocessors to cause the computing system to name the matching relatedimages collecting or individually using the at least one user-definednaming rule.
 13. The computing system of claim 3, wherein the one ormore software modules are further configured for execution by the one ormore computer processors to cause the computing system to display thematching related images based on one or more display rules.
 14. Thecomputing system of claim 13, wherein the one or more display rules areuser-defined.
 15. The computing system of claim 13, wherein the one ormore display rules define at least one selected from a group consistingof timing, positioning, and size of the matching related images.
 16. Thecomputing system of claim 13, wherein the one or more display rulesinclude rules for selecting a subset of the matching related images todisplay.
 17. The computing system of claim 13, wherein the one or moredisplay rules includes rules for interleaving images from differentimage series.
 18. The computing system of claim 13, wherein the one ormore display rules include one or more triggers for warnings when adisplay rule is not satisfied.
 19. The computing system of claim 2,wherein the one or more DICOM attributes include at least one selectedfrom a group consisting of patient name, an exam type, and a date of animage.
 20. The computing system of claim 2, wherein the common namingformat includes a categorization table that defines a particular namewhen one or more certain conditions are met.
 21. The computing system ofclaim 20, wherein the particular name is predetermined or based on dataassociated with an image.